Papers with transformer-based reasoning cell
Social Commonsense Reasoning with Multi-Head Knowledge Attention (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Social Commonsense Reasoning requires understanding of text, knowledge about social events and their pragmatic implications, as well as commonsense reasoning skills. |
| Approach: | They propose a multi-head knowledge attention model that encodes semi-structured commonsense inference rules and learns to incorporate them in a transformer-based reasoning cell. |
| Outcome: | The proposed model improves performance on two reasoning tasks that require different reasoning skills. |